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ABSTRACT 

In this paper, we describe the general framework to describe 
the diffusion operators associated to a positive matrix. We 
define the equations associated to diffusion operators and 
present some general properties of their state vectors. We 
show how this can be applied to prove and improve the con- 
vergence of a fixed point problem associated to the matrix 
iteration scheme. The approach can be understood as a 
decomposition of the matrix- vector product operation in el- 
ementary operation at the vector entry level. 
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matics]: Graph Theory — Graph algorithms 
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1. INTRODUCTION 

In this paper, we assume that the readers are already fa- 
miliar with the idea of the fluid diffusion associated to the 
D-iteration [2] to solve the equation: 

X = P.X + B 

and its application to PageRank equation [3]. 

For the general description of alternative or existing iter- 
ation methods, one may refer to [TJ [5] . 

2. NOTATION 

We will use the following notations: 

• P € (IR + ) JVxJV a positive matrix; 

• Id e (lR + ) JVxJV the identity matrix; 

• Ji the matrix with all entries equal to zero except for 
the i-th diagonal term: (Ji)u = 1; 

• I — {ii,i2, ..,i n , ■■•} the sequence of nodes for the dif- 
fusion: i k G {1, .., N}; 
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• a v : WL N — > 1R the scalar product for a given strictly 
positive vector V > 0: o v {X) =< V\X >= J2iLi v i x i\ 

• e the normalized unit column vector 1/N(1, ..,1)*. 
We say that P is cr„-decreasing if: 

VX £ (M + ) N ,a v (PX) < a v (X). 

We define P a = (I - a)I d + aP. 
Then, we have the following results: 

Theorem 1. a v -decreasing property is stable by compo- 
sition of operators (matrix product). 

If P is er„ -decreasing, for a > 0, P a is a v -decreasing. 

If P is a v - decreasing, for (a, a') £ (M + ) 2 such that a < 
a, a v (P a 'X) < a v (P a X). 

Proof. The first point is obvious. The other points are 
based on the linearity of a v . 

2.1 Diffusion operators 

We define the iV diffusion operators associated to P by: 

Pi = Id — Ji + P-Ji 

Theorem 2. If P is a v -decreasing, then the diffusion op- 
erators Pi are a v -decreasing. Therefore, for a > 0, 

Pt =I d + a(P-I d ).J i 

is a v -decreasing. 

Proof. a v (Pi.X) = a v (X) + a v {P.J l .X) -a v (Ji.X) and 
we have o~ v { P. Ji.X) < a v (Ji.X), therefore a v (Pi. X) < a v (X). 
The last point is the application of Theorem [T] to Pi. 

We recall that the D-iteration is defined by the couple 
(P, B) e rR JVxJV x IR^ and exploits two state vectors: H n 
(history) and F n (residual fluid): 

F = B (I) 

F n = P in F n -i (2) 

and 

Ho = 0=(0,..0)* (3) 

H n = H n -!+ J in F n -l. (4) 

The D-iteration is the joint iteration on (F n , H n ). 
Now, we consider a bit more general diffusion iterations 
as follows: 

K = P£K-i- (5) 



and 

H„ = H"_x + a n J in F^_ 1 (6) 

where a n > 0. If for all n, ct n = 1, we have the usual 
diffusion iteration. 

Theorem 3. (F£,H%) satisfies: 

HI + F: = P.H: + B. (7) 

Proof. The proof is the same as for the a = 1 (cf. [3]) 
diffusion equations by induction and using equations ((5J and 

©. 

Theorem 4. Assume we choose Fo > and H = 0. 
Then, F„ and H„ are positive and (H")i is an increasing 
function for all i. 

If P is o v - decreasing, then a v (F^) is a decreasing func- 
tion. 

Proof. The proof is straightforward. 

Theorem 5. If we build the two diffusion iterations {F",H") 

and (F" ,H" ) from the same initial vector Fo (Ho = 0) 
and for the same diffusion sequence I , if for all n, < a n < 
a' n < 1, then we have: 

• <T V {F?) <av{F%); 

• H" > H% (for each vector entry); 

. +K' >HZ + K- 

Proof. The first inequality is a direct consequence of 
Theorem [2] and Theorem [1] The third is a direct conse- 
quence of the second inequality using Theorem [3] For the 
second inequality, we prove by induction: we have obviously 
Hi > H?. assume we have, H™' > H™. Then, from ©: 

H n +i = 

^n + lJin + l Fn 
> Fin + a n + lJi n + 1 F" 

and 

H"+i = H™ + a n+ iJ in+1 Fn 
We need to prove that: 

Hn — H" > a n+1 Ji n+1 (F£ — F™ ). 

For i ± i n+1 , - HZ)i > and (J;„ +1 (K - F"'))i = 

0. For i — i n +i, we only need to handle the case (F" — 
K'k+i > 0. We use the relation: H™' - H° > F™ - F n Q ' 
to get the inequality. 

Remark 1. The power iteration X n = P.X n ~\ can be 
described in the above scheme (F",H") with X n = F^ n 
taking Fo = Xo and if we apply the cyclic sequence 1,..,N 
(i n = n mod N) where ctkN+i < 1 is chosen such that we 
diffuse exactly (P k .Xo)i (such a value exists and is less than 
1 because after the diffusion of nodes l,..,i the residual fluid 
on (i + l)-th node can only be increased). 



2.2 Application to DI+ 

The D-iteration adaptation to the general case (DI+) has 
been presented in [J. For the sake of simplicity, we show 
how the above results apply to the DI+ only for the case 
when P is an irreducible ergodic positive matrix having 1 as 
spectral radius. First, we take for v the left-eigenvector of 
P such that v*.P = v. 

DI+'s idea is to apply the diffusion process to (P, P.e — e). 

Theorem 6. If we choose the sequence of nodes I such 
that we only diffuse negative fluids, then the diffusion applied 
on (P, P.e — e) converges to X — e. 

Proof. The diffusion from P.e — e can be decomposed 
as the difference of two diffusion process {F% , H" ) and 
(F£,H%) as follows: we start with Fo = e. For the N first 
diffusions, we choose i n — n and 

• forP£", a„ = 0; 

• for P" n , a' n such that we diffuse exactly 1/N (such a 
value exists and is less than 1 because after the diffu- 
sion of nodes 1, .., i the residual fluid on (i + l)-th node 
can only be increased). 

Then we have: F% = e, H% = and F$ = P.e, H$ = 
e. Then from the (N + I)-th diffusion, we apply exactly 
the same sequence with a n = a' n = 1. From Theorem [5] 
we have H n + e = H™ — H™ > and we have a v (F n ) = 
a v{F™ — F") = 0. If we only diffuse negative fluids, this 
means that H n is a decreasing function (per entry). Since 
we have < H n + e < e, H n is convergent. 

It has been shown in [3] that \F n \ v = |«» x (F n )i\ is 
a decreasing function. The convergence of H n implies of 
course the convergence to zero of F n ■ 

Remark 2. We observed that the implicit strategy on DI+ 
(diffusion of negative fluids) can easily bring a computation 
time reduction factor above 10. 

Remark 3. If we mix the diffusion of positive and neg- 
ative fluids, there is no guarantee that the algorithm DI+ 
converges and there is snake-configuration example to prove 
that we may oscillate (1 — >• 2 and 1 — > 3; 2 — > 4; 3 — > 5; 
4 — > 1; 5 — > 1). Now one can easily understand that the op- 
timal sequence may require the diffusion of positive fluids (in 
the above snake-configuration, the optimal choice is choosing 
once the node 1 which has a positive fluid assuming a weight 
of 0.5 on 1 — > 2 and 1 — ^ 3^. If P is irreducible and ergodic, 
the author conjectures that we still have the convergence with 
H n + e < 1, if one choose only positive fluids. The DI-\- al- 
gorithm should converge when P is not ergodic. The DI+ 
algorithm should even converge when P is not irreducible 
under the condition that we only take negative fluids. 

3. CONCLUSION 

We presented the general equations of the diffusion op- 
erators and the general properties of the associated state 
vectors with an illustration of the application to prove the 
convergence of DI+ with a new sequence I choice strategy. 

4. REFERENCES 

[1] G. H. Golub and C. F. V. Loan. Matrix Computations. 
The Johns Hopkins University Press, 3rd edition, 1996. 



[2] D. Hong. D-iteration method or how to improve 

gauss-seidel method. arXiv, 

http://arxiv.org/abs/1202.1163, February 2012. 
[3] D. Hong. Optimized on-line computation of pagerank 

algorithm, submitted, http://arxiv.org/abs/1202.6158, 

2012. 

[4] D. Hong and P. Jacquet. Optimizing the eigenvector 
computation algorithm with diffusion approach. arXiv, 
http://arxiv.org/abs/1206.3177, June 2012. 

[5] Y. Saad. Iterative Methods for Sparse Linear Systems. 
Society for Industrial and Applied Mathematics, 
Philadelphia, PA, USA, 2nd edition, 2003. 



